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Abstract. Babson and Steingrfmsson introduced generalized per- 
mutation patterns that allow the requirement that two adjacent 
letters in a pattern must be adjacent in the permutation. We con- 
sider rt-permutations that avoid the generalized pattern 1 — 32 and 
whose k rightmost letters form an increasing subword. The num- 
ber of such permutations is a linear combination of Bell numbers. 
We find a bijection between these permutations and all partitions 
of an (n — l)-element set with one subset marked that satisfy cer- 
tain additional conditions. Also we find the e.g.f. for the number 
of permutations that avoid a generalized 3-pattern with no dashes 
and whose k leftmost or k rightmost letters form either an increas- 
ing or decreasing subword. Moreover, we find a bijection between 
n-permutations that avoid the pattern 132 and begin with the pat- 
tern 12 and increasing rooted trimmed trees with n + 1 nodes. 



1. Introduction and Background 

All permutations in this paper are written as words tt = a\a2 ■ ■ ■ a n , 
where the a, consist of all the integers 1,2,... , n. 

A pattern is a word on some alphabet of letters, where some of the 
letters may be separated by dashes. In our notation, the classical per- 
mutation patterns, first studied systematically by Simion and Schmidt 



5chSim|1 , are of the form p = 1 — 3 — 2, the dashes indicating 
that the letters in a permutation corresponding to an occurrence of p 
do not have to be adjacent. In the classical case, an occurrence of a 
pattern p in a permutation it is a subsequence in 7r (of the same length 
as the length of p) whose letters are in the same relative order as those 
in p. For example, the permutation 264153 has only one occurrence 
of the pattern 1 — 2 — 3, namely the subsequence 245. Note that a 
classical pattern should, in our notation, have dashes at the beginning 
and end. Since most of the patterns considered in this paper satisfy 
this, we suppress these dashes from the notation. 

In ||BabStcin| Babson and Steingrfmsson introduced generalized per- 



mutation patterns ( GPs) where two adjacent letters in a pattern may be 
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required to be adjacent in the permutation. Such an adjacency require- 
ment is indicated by the absence of a dash between the corresponding 
letters in the pattern. Thus, a pattern with no dashes corresponds to 
a contiguous subword anywhere in a permutation. For example, the 
permutation tt = 516423 has only one occurrence of the pattern 2-31, 
namely the subword 564, but the pattern 2-3-1 occurs also in the sub- 
words 562 and 563. The motivation for introducing these patterns in 
BabSteinf was the study of Mahonian statistics. 



A number of interesting results on GPs were obtained by Claesson 
Ulaesj| . Relations to several well studied combinatorial structures, such 
as set partitions, Dyck paths, Motzkin paths and involutions, were 
shown there. In |[Kit 1|| the present author investigated simultaneous 
avoidance of two or more 3-letter GPs with no dashes. Also there 
is a number of works concerning GPs by Mansour (see for example 
Mansl| , |Mans2j| ). 



In this paper we consider avoidance some generalized 3-patterns with 
additional restrictions. The restrictions consist of demanding that a 
permutation begin or end with the pattern 12 ... k or the pattern k{k — 
l)...l. 

It turns out that the number of permutations that avoid the pattern 
1 — 32 and end with the pattern 12 ... k is a linear combination of the 
Bell numbers. The n-th Bell number is the number of ways a set of n 
elements can be partitioned into nonempty subsets. We find a bijection 
between these permutations and all partitions of an (n — l)-element 
set with one subset marked that satisfy certain special conditions. In 
particular, in Theorem |^, we investigate the case k = 2. We get that 
the total number of partitions of an (n — l)-element set with one part 
marked, is equal to the number of (1 — 32)-avoiding n-permutations 
that end with a 12-pattern. Lemma Q gives us an identity involving 
the Bell numbers and the Stirling numbers of the second kind, which 
seems to be new. In Theorem |5] we prove that the number of 132- 
avoiding n-permutations that begin with the pattern 12 is equal to the 
number of increasing rooted trimmed trees with n + 1 nodes. 

In Sections 4 - 7, we give a complete description (in terms of expo- 
nential generating functions (e.g.f.)) for the number of permutations 
that avoid a pattern of the form xyz and begin or end with the pattern 
12 ... k or the pattern k(k — 1) ... 1. We record all the results concern- 
ing these e.g.f. in the table in Section 7. The case k — 1 is equivalent 
to the absence of the additional restriction. This case was considered 



in 
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We observe that avoidance of some pattern with the additional re- 
strictions described above, in fact is equivalent to simultaneous avoid- 
ance of several patterns. For example, beginning with the pattern 
12 is equivalent to the avoidance of the pattern [21) in the Babson- 
Steingrimsson notation. Thus avoidance of the pattern 132 and begin- 
ning with the pattern 12 is equivalent to simultaneous avoidance of the 
patterns 132 and [21). Also, ending with the pattern 123 is equivalent 
to simultaneously avoiding the patterns (132], (213], (231], (312] and 
(321]. 



2. Set partitions and pattern avoidance 
We recall some basic definitions. 

A partition of a set S is a family, 7r = {A\, A 2 , . . . ,Ak}, of pair- 
wise disjoint non-empty subsets of S such that S = Uj-Aj. The total 
number of partitions of an n-element set is called a Bell number and is 
denoted B n . 

The Stirling number of the second kind S(n, k) is the number of ways 
a set with n elements can be partitioned into k disjoint, non-empty 
subsets. 

Proposition 1. Let P(n, k) be the number ofn-permutations that avoid 
the pattern 1 — 32 and end with the pattern 12 ... k. Then 

n-k / 1 x 

j>(»,*)=E( 7 

Proof. Suppose a permutation n = air avoids the pattern 1 — 32 and 
ends with the pattern 12 ... k. The letters of r must be in increasing 
order, since otherwise we have an occurrence of the pattern 1 — 32 
involving 1. Also, a must avoid 1 — 32. If \a\ = i then obviously 
< i < n — k and we can choose the letters of a in ("7 1 ) wa Y s - By 
|CJlaes| , Proposition 5], the number of z-permutations that avoid the 
pattern 1 — 32 is equal to Bi, hence there are Bi ways to form a. □ 



n— 1 / \ n 

Lemma 2. We have I \Bi = ■ S(n,i). 

i=o \ l ' i=0 

Proof. The identity can be proved from the recurrences for S(n, k) and 
B n , but we give a combinatorial proof. 

The left-hand side of the identity is the number of ways to choose % 
elements from an n-element set, and then to make all possible partitions 
of the chosen elements. 
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The right-hand side is the number of ways to partition a set with n 
elements into i disjoint non-empty subsets (i — 1, 2, . . . , n) and mark 
one of the subsets. For example if n = 4 then 1 — 24 — 3 and 1 — 24 — 3 
are two different partitions, where the marked subset is overlined. 

A bijective correspondence between these combinatorial interpreta- 
tions is given by the following: For the left-hand side, after partitioning 
the i chosen elements, let the remaining n — i elements form the marked 
subset in the partition. □ 

The formula for P(n, k) in Proposition [I], applied to k — 2, and 
Lemma now give the following theorem: 

Theorem 3. The total number of partitions of an (n — l)-element set 
with one part marked, is equal to the number of (1 — 32) -avoiding n- 
permutations that end with the pattern 12. 

We give now a direct combinatorial proof of this theorem. 

Proof. Suppose P = Si — S 2 — ■ ■ ■ — Sk is a partition of an {n — 1)- 
element set into k subsets with one marked subset and 7] is the word 
that consists of all elements of Si in increasing order. We may, without 
loss of generality, assume that min(Si) < min^) if i > j. In particular, 
1 G Sk- There are two cases possible: 

1) Sk = {1} {Sk is not marked set); 

2) Either ^ = 1 or 1 G ^ and \Sk\ > 2. 

In the first case, to a partition P = Si — S 2 — - • -—Si •— Sk-i — 1 we 

associate the permutation n(P) = nT{T 2 . . . Ti_iT i+ i . . . T/ c _ 1 lTj, which 
is (1 — 32)-avoiding and ends with the pattern 12 since Si ^ 0. For 
example 4 - 23 - 1 1-> 54123. 

In the second case we adjoin n to a marked subset, and then consider 
the permutation 7r(P) = T{F 2 ■ ■ .T^. This permutation is obviously 
(1 — 32)-avoiding since min(S'j) < min(Sj) if i > j and the letters in Tj 
are in increasing order. Also it ends with the pattern 12. For example 
5 - 34 - 12 ^ 534612, and 5 - 234 - T ^ 523416. 

Obviously in both cases we have an injection. 

Now it is easy to see that the correspondence above is a surjection as 
well. Indeed, for any (1 — 32)-avoiding permutation 7r that ends with 
the pattern 12, we can check if 7r begins with n or not and according to 
this we have either case 1) or 2). In the first case, we remove n, then 
read tt from left to right and consider all maximal increasing intervals. 
The elements of each such interval correspond to some subset, and we 
let all the letters to the right of 1 constitute the marked subset. In the 
second case, we divide 7r into maximal increasing intervals, and let the 
letters of each interval correspond to a subset. Then we let the interval 
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containing n be the marked subset. Thus we have a surjection. So the 
correspondence is a bijection and the theorem is proved. □ 

The following theorem generalizes Theorem [3| 

Theorem 4. Let P = S\—S2 — - ■ -—Si be a partition of{l, 2, . . . , n— 1} 
into I subsets with subset Si marked. We assume also that 1 6 Sg. Then 
P(n, k) counts all possible marked partitions of {1, 2, . . . , n — 1} that 
satisfy the following conditions: 

1) if i = I (the last subset is marked) then \Si\ > k — 1; 

2) 7^ C- and \Se\ ^ 1 then \Se\ > fc; 

3) if i ^ £ and \S#\ = 1 i/ien |Si| > k — 1. 

Proof. A proof of this theorem is similar to the proof of Theorem |3|. 
We assume that min(Si) < min(Sj) for i > j and consider three cases. 

If a partition satisfies 1), that is P — S\ — S2 — • ■ ■ — Si and \Si\ > 
k — 1, then adjoining n to Si guarantees that the permutation 7r(P) = 
T1T2 which is (1 — 32)-avoiding, ends with k letters in increasing 

order. 

In case 2), we adjoin n to the marked subset and consider 7r(P) = 
T{T 2 . . . T(. This permutation avoids the pattern 1 — 32 and ends with 
the pattern 12 ... k since \Si\ > k. 

In case 3), to a partition P = S\ — S2 — ■ • • — Si — ■ ■ • — Sk-i — 1 we 
associate the permutation ir(P) = nTiT 2 . . . Tj_iTj + i . . . T^-ilTi, which 
is (1 — 32)-avoiding and ends with at least k letters in increasing order 
since \Si\ > k — 1. 

That this correspondence is a bijection can be shown in a way similar 
to the proof of Theorem [|. □ 

3. Increasing rooted trimmed trees and pattern 

avoidance 

In an increasing rooted tree, nodes are numbered and the numbers 
increase as we move away from the root. A trimmed tree is a tree where 
no node has a single leaf as a child (every leaf has a sibling). 

Theorem 5. Let A n denote the set of all n-permutations that avoid the 
pattern 132 and begin with the pattern 12. The number of permutations 
in A n is equal to the number of increasing rooted trimmed trees (IRTTs) 
with n + 1 nodes. 

Proof. A right-to-left minimum of a permutation 7r is an element a, 
such that <2j < a,j for every j > i. 

We describe a bijective correspondence F between the permutations 
in A n and IRTTs with n + 1 nodes. 
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Suppose 7r G A n and tt = Po^o-Pi^i • • • PkQ-k, where eij are the right- 
to-left minima of tt and Pj are (possibly empty) subwords of tt. We 
construct a IRTT T = -F(7r) with n+ 1 nodes as follows. The root of T 
is labelled by and do, ax, ■ ■ ■ ,Q>k are the labels of the root's children if 
we read them from left to right. Then we let the right-to-left minima 
of Pi be the labels of the children of cij and so on. It is easy to see that, 
since tt avoids 132 and begins with 12, T avoids limbs of length 2. Also, 
T is an increasing rooted tree and hence T is a IRTT. For instance, 



F(2 9 10 5 3 1 11 13 14 8 12 7 4 6) = 



6 



2 3 7^ 
5^ 8 12 



9 10 11 13 14 

Obviously, the correspondence F is an injection. 

To see, that F is a surjection, we show how to construct the permu- 
tation tt G A n that corresponds to a given IRTT T. The main rule is 
the following: If a* and siblings, and cij < aj, then the labels 

of the nodes of the subtree below aj, are all the letters in tt between 
<2j and aj, that is, a^x, Oj+2, • • • , If a» is a single child, then the 
labels of the nodes of the subtree below a, appear immediately left of 
a, in tt. That is, if there are k nodes in the subtree below a, then the 
k corresponding labels form the subword a^k^i-k+i ■ ■ - CLi-x- We now 
start from the first level of T, which consists of the root's children, and 
apply this rule. After that we consider the second level and so on. The 
fact that T is a IRTT ensures that tt avoids the pattern 132 and begins 
with the pattern 12. Thus, F is a bijection. □ 



4. Avoiding 132 and beginning with 12 ... k or k(k - 1) ... 1 

Let EP(x) denote the e.g.f. for the number of permutations that 
avoid the pattern q and begin with the pattern p. 

If k = 1, then there is no additional restriction, that is, we are dealing 
with avoidance of the pattern 132 (no dashes) and thus 



(1) El. 



1 



132 \ x ) — * rx _ f 2 



fo e-*/* eft' 

since this result is a special case of [|ElizNoy , Theorem 4.1] and | Kit2 . 
Theorem 12]. 
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Theorem 6. We have 



-x 2 /2 



E-lvn(x) — _ , .„ , . X 1, 



fc-2- 



^ 132V ; " l-/ x e-* 2 /2 d f 

and /or k > 3 

= £ ^ fc " 2 ■ • • [ (e~ t?/2 - Jr^y) dhdt 2 ■■■dt 

Proof. Let i^j. denote the number of n-permutations that avoid the 
pattern 132 and begin with an increasing subword of length k > 0. 
Let it be such a permutation of length n + 1. Also, suppose k ^ 2. If 
7r = cxlr then either a = e or a ^ e where e denotes the empty word. If 
o = e then r must avoid 132 and begin with an increasing subword of 
length k — 1. Otherwise a must avoid 132 and begin with an increasing 
subword of length k, whereas r must begin with the pattern 12, or be 
a single letter (there are n ways to choose this letter), or be e. This 
leads to the following: 

(2) E n+ i } k = E n> k-i + ( . j E i)k E n _i )2 + nE n _i k + E U)k . 

Multiplying both sides of the equality with x n /n\ and summing over 
all n we get the following differential equation 

(3) ^E\j 2 \x) = {E\Ux) +x + l)E\l 2 -\x) + Ell^ix), 

with the initial conditions El^ 2 - k (0) = for k > 3. 

Observe that equality (f|) is not valid for k = 2. Indeed, if k — 2, 
then it is incorrect to add the term E n ^~i = E n ^ in (|2|), since this term 
counts the number of permutations n = It with the only restriction 
for r that it must avoid 132. The absence of an additional restriction 
for r means that the 3 leftmost letters of tt could form the pattern 132. 
However, we can use @ to find E^ 2 (x) by letting k equal 1. In this 
case we have 

^320*0 = (E\l 2 {x) +x + l)El 32 (x), 

which gives 

(4) B$,{x) = 1 _ M - « - 1. 

For the case k > 3, it is convenient to write E\ 32 (x) in the form 

-12 



EU 2 (x) = B'(x)-x-l, 
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where B(x) = — ln(l — J* e"^ I 2 dt) and thus B'{x) = exp(B(x) — ^). 
So (0) is equivalent to the differential equation 

^E^ k (x) = B'{x)E\l 2 -\x) + E\^ k - l \x) 
which has the solution 



E\^\x) = [ X e-^ El^it) dt 
Jo 



1321 Vo ^32 (t) 



rti pl2...(fe-2)/, \ 



JO 



,,,,(./• i / / ...y 4s (^i) 



JO 

Using (|1|) and (|J) we now get the desired result. □ 

Using the formula for E^ 2 ' ( x ) i n Theorem |] one can derive, in 
particular, that 

r~il23 / \ *^ 2/ ^ ^ 

EMX} = ~2~ X ~Y + l-f Q x e-tyidt • 
Theorem 7. For /c > 2 

F 132 / A _ -^1 132 ( X ) f X fk-l -t 2 /2 7, 

^fc(fe-i)...iW - 1 xj y o f e at - 

Proof. We proceed as in the proof of Theorem |6|. 

Let R n ^k denote the number of n-permutations that avoid the pattern 
132 and begin with a decreasing subword of length k > 1 and let tt be 
such a permutation of length n + 1. Suppose also that tt = air. If 
t = e then, obviously, there are R nt k ways to choose a. If \t\ = 1, 
that is, 1 is in the second position from the right in tt, then there are 
n ways to choose the rightmost letter in tt and we multiply this by 
Rk,n-i, which is the number of ways to choose a. If |t| > 1 then r 
must begin with the pattern 12, otherwise the letter 1 and the two 
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leftmost letters of r form the pattern 132, which is forbidden. So, in 
this case there are ^ i>0 (") Ri^E n -i t2 such permutations with the right 
properties, where i indicates the length of a and E n _ it2 is defined in the 
proof of Theorem ^. In the last formula, of course, Ri^ = if i < k. 
Finally we have to consider the situation when 1 is in the k-th position. 
In this case we can choose the letters of a in L"i) ways, write them in 
decreasing order and then choose r in E n _k+i,2 ways. Thus 



(5) 

Rn+X,k = Rn,k + ^-Rn-l,fc + ( . J Ri,kE n -i )2 + ( , ^ J ^n-ifc+1,2- 

i>0 ^ ' 

We observe that (|5|) is not valid for n = k — 1 and n = k. Indeed, if 
1 is in the k-th position in these cases, the term ( fc " 1 )£ , n _fc +1)2 , which 
counts the number of such permutations, is zero, whereas there is one 
"good" (n + l)-permutation in the case n = k — 1 and n "good" (n+l)- 
permutations in case n = k. Multiplying both sides of the equality with 
x n /n\, summing over n and using the observation above (which gives 
the term x 1 j(k — 1)! + kx k /k\ in the right-hand side of Equalion (|6])), 
we get 



(6) = (ElUx) + x + l) (eST^x) + 

with the initial condition Ej^_^ 1 (0) = 0. We solve the equation in 
the way proposed in Theorem and get 

pfc(fc-i)...i/ x _ E l 32 (x) [ x {E\l 2 (t) + t+ l)t k ~ l _ El 32 (x) [ x t2/2 

□ 

For instance, 

Moreover, the integral J* t fc-1 e~* 2 / 2 dt from the formula for E^~^''' X (x) 
can be solved to show that E k % 2 (x) equals 

( fc /2 _ 1)!2 */2-i f x _ e „ x , /2 "g 1 ^ 



(k - 1)!(1 - y/\ erf(x)) \ ^ 2*i! 
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if k is even, and 
1 



(Jfe-l)!! 



1 



1 



f erf (x) 



1 



( fc - 3 )/ 2 _2i+l 
-x 2 /2 x 



2 ~"V~y \ i=0 

if is odd. 

In the formula above, erf(x) is the error function: 

2 



(2i+l)H 



erf (x) 



"* dt. 



5. Avoiding 123 and beginning with k(k - 1) ... 1 or 12 ... k 



If k = 1, we have no additional restrictions and, according to [|ElizNoy 
Theorem 4.1], 



E l 123 (x) 



V3 



,x/2 



2 cos h§x + | 



Theorem 8. For k > 2 



a x/2 



(k - 1)! cos (^ + f) ^° 



-^V-^in 



V3. 



7T 

6 



dt. 



In particular, 



r-,21 / \ / 7T \ 1 

-^123 ) = ~ ~ ^ an I ~ ~ X + ~ I ~ x ~ -■ 



6 



Proof. Let P nj fc denote the number of n-permutations that avoid the 
pattern 123 and begin with a decreasing subword of length k. We 
observe that we can use arguments similar to the proof of Theorem [/] 
to get the recurrence formula for P n ,k- Indeed, we only need to write 
the letter P instead of R and E in (El): 



(7) Pn+l,k — Pn,k + nP n ^ ljk + ( • j Pi,kPn-i,2 + ( ^ _ ^ J P, 



n-k+1,2- 



This formula is valid for k > 1. Multiplying both sides of the equality 
with x n j n\, summing over n and reasoning as in the proof of Theorem [7], 
we get: 



d 



dx E«t l ^\x) = {E-Ux)+x + l)[E 



fe(fc-i)...i 

123 1 



X 



k-l 



X) 



(k-l)\ 
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with the initial condition E^s 1 ^'" 1 (0) = 0. To solve (§), we need to 
know E 2 \^(x). To find it, we consider the case k = 1. In this case we 
have almost the same recurrence as we have in (|7|) , but we must remove 
the last term in the right-hand side: 

Pn+1,1 — Pn,l + nP n -l t i + f . \ Pi^P n -i,2- 

After multiplying both sides of the last equality with x n /n\ and sum- 
ming over n, we have 



^El 23 (x) = {ElUx) +x + l)E{ 23 (x), 



and thus 



d pi 



E?L(x) = dx U3 : ' - x - 1 = — tan I — x + - I - x 
123V ; Pxix) 2 ^2 6 J 2 

Now we solve (||) in the way we solved Equalion (^) and get 
EUt^x) = r- f e^V^sin (^ t +I)dt. 



(A: -1)1 cos (fx + f) 



o 



2 6 



□ 



The following theorem is straightforward to prove. 
Theorem 9. We have E}h' k { x ) = for k > 3 and 



v/3 e x / 2 1 V3 / V3 



^usO*) = ^(^-^m^) = ^ — ^-r-^tan 



7T 



6. Avoiding 213 and beginning with k(k - 1) ... 1 or 12 ... k 
If k — 1, then by [ ]EEzNoy| , Theorem 4.1] or |Kit2| , Theorem 12] 

= i-/; e -* 2 / 2 dt - 

Theorem 10. For /c > 2 

/■x *t k-2 T(t)-T(s) 

E 2u k W = / / 7, * 7i z^r, : d*dt, 



lo Jo (Jfe-2)!(1- J*e- m2 / 2 dm) 
where T(x) = -x 2 /2 + £ TZ0^I s dt 
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Proof. Let A n denote the number of n-permutations that avoid the 
pattern 213 and let B n denote the number of n-permutations that avoid 
213 and begin with the pattern 12 ... k. Let C n denote the number of 
n-permutation that avoid 213, begin with the pattern 12 ... k and end 
with the pattern 12 and let D n denote the number of n-permutations 
that avoid 213 and end with the pattern 12. Also, let A(x), B(x), 
C(x) and D{x) denote the e.g.f. for the numbers A n , B n , C n and D n 
respectively. 

We observe, that 



since, by using the reverse and complement discussed in the next sec- 
tion, there are as many permutations that avoid the pattern 213 and 
end with the pattern 12 as those that avoid the pattern 132 and begin 
with the pattern 12. Also, A(x) = El 12 (x) and B(x) = E\l^ k (x). 

Suppose now that n = a{n + \)r is an (n + 1) -permutation that 
avoids the pattern 213 and begins with the pattern 12 ... k. So a must 
avoid 213, begin with 12 ... k, but also end with the pattern 12 since 
otherwise the two rightmost letters of a together with the letter (n + 1) 
form the pattern 213, which is forbidden. For r, there is only one 
restriction — avoidance of 213. So if \o~\ = i then we can choose the 
letters of a in ( n ) ways, which gives ^2 i>0 CjCiAi permutations that 
avoid the pattern 213 and begin with the pattern 12 ... k. Moreover, 
it is possible for (n+1) to be in the kth position, in which case we 
choose the letters of a in (^-J ways and arrange them in increasing 
order. Thus 



Multiplying both sides of this equality with x n /n\ and summing 
over n, we get 



with the initial condition B(0) = 0. 

To solve @ we need to find C(x). Let n = a(n + l)r be an 
(n + l)-permutation that avoids the pattern 213, begins with the pat- 
tern 12 ... k and ends with the pattern 12. Reasoning as above, a must 
avoid the pattern 213, begin with the pattern 12 ... k and end with the 
pattern 12, whereas r must avoid 213 and end with the pattern 12. 
This gives ^2 i>0 (")CjD n _j permutations counted by C n+ \. Also, the 





(9) 
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letter (n + 1) can be in the kth position, which gives (,™ 1 ).D n ,_(fc_i) per- 
mutations, and this letter can be in the (n + l)st position, which gives 
C n permutations that avoid the pattern 213, begin with the pattern 
12 ... k and end with the pattern 12. Also, if n + 1 = k and all the 
letters are arranged in increasing order, then (n + 1) is in the (n+ l)st 
position, but this permutation is not counted by C n above. So 

C n +1 = ( . j CiD n -i + f J D n _(fc_l) + C n + S nt k-1, 

where 5 n ^ is the Kronecker delta, that is, 



n,k 



1, if n = k, 
0, else. 



Multiplying both sides of the equality with x n /n\ and summing 
over n, we get 



(10) C'{x) = (D(x) + l)C(x) + (D(x) + 1) 



To solve ([UJ), it is convenient to introduce the function T(x) such 
that T'(x) = D(x) + 1. Thus 

rx px e -* 2 / 2 

T(x) =x+ D{t)dt = -x 2 /2 + / 7t dt, 

Jo Jo 1 



l-f e- s2 / 2 ds 



and we need to solve the equation 

C'{x) =T'{x)C{x)+T'{x) 

with (7(0) = 0. 

The solution to this equation is given by 



Now we substitute (7(a;) into @ to get the desired result. □ 
Theorem 11. For k > 2 

™fc-l fc ~ 2 /-a; /■<:„ /-ti /^r (+\ \ X 

fc(fc-l)...!/ x ^ , / / / ^*-tiW + "n,fc-2 
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where 

px rt k _ 2 nti ( p -t 2 /2 \ 

w^LL -L ^'" G-i^ "'" 1 )^ 1 

with T( X ) = -x 2 /2 + /; dt. 

Proof. Let A n denote the number of n-permutations that avoid the 
pattern 213 and let B nk denote the number of n-permutations that 
avoid 213 and begin with the pattern kik — 1) ... 1 for k > 2. Let 
C n> k denote the number of n-permutation that avoid 213, begin with 
k{k — 1) ... 1 for k > 2 and end with the pattern 12 and let D n denote 
the number of n-permutations that avoid 213 and end with the pattern 
12. Also, let A(x), B k (x), Ck(x) and D{x) denote the e.g.f. for the 
numbers A n , B Ujk , C n ,k and D n respectively. In the proof of Theorem [L(] 
it was shown that D(x) = e~ x2 l 2 / (1 — J® e~ t2 / 2 dt) — x — 1 and A(x) = 

E\ l2 (x). Moreover, B k (x) = E k 2 ^~ 1] - 1 (x). 

Suppose now that 7r = a(n+l)r is an (n+l)-permutation that avoids 
213 and begins with the pattern k(k — 1) ... 1. So a must avoid 213, 
begin with k(k — 1) ... 1, but also end with the pattern 12 if \a\ > 2, 
since otherwise the two rightmost letters of a together with the letter 
(to + 1) form the pattern 213 which is forbidden. For r, there is only 
one restriction - avoidance of 213. So if |<r| = % then we can choose 
the letters of a in ("J ways, which gives ^ i>0 mCj^Aj permutations 
counted by B n+ljk . Also, it is possible for (to + 1) to be the leftmost 
letter, in which case the remaining letters must form a n-permutation 
that avoids 213 and begins with the pattern (k — 1) (k — 2) ... 1. Thus 



'11) Bn+i,k — ( ■ jCi t kA n ^i + B n> k-i 

i>0 ^ ' 



However, this formula is not valid when k = 2 and to = 0. Indeed, since 
Bq i = Aq = 1, it follows from the formula that B\ % = 1, which is not 
true, since B 12 must be 0. So, in the right-hand side of QTTD, we need 
to subtract the term 

J 1, if to = and k — 2, 
ln ' k ~ \ 0, else. 

Multiplying both sides of the obtained equality by x n /n\ and summing 
over to, we get, that for k > 3 

(12) ^-B k (x) = C k (x)A(x) + B k ^(x), 

ax 
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with the initial condition B k (0) = 0, and 

(13) 4~B 2 (x) = C 2 (x)A(x) + B 1 (x) - 1, 

ax 

with the initial condition -82(0) = 0. 

The solution to differential equations fljjD and Q13D is given by 



B k (x) = + E f f n ■ ■ • f Ck -f + 6 2 :: k ; 2 dtdt ^ ■ ■ ■ dt - 

f^Jo Jo Jo l-f*e- m2 / 2 dm 

So, to prove the theorem, we only need to find C k (x). 

Suppose 7r = a{n + l)r be an {n + l)-permutation that avoids the 
pattern 213, begins with the pattern k(k — 1) ... 1 and ends with the 
pattern 12. It is clear that a must avoid 213, begin with the pattern 
k(k — 1) . . . 1 and end with the pattern 12, whereas r must avoid 213 
and end with the pattern 12. There are ^ i>0 (") C itk D n _i permutations 
with these properties. Also, the letter in + 1) can be in the leftmost 
position, which gives C n ^-i permutations, and (n + 1) can be in the 
rightmost position, which gives C n ^ permutations, since in this case, 
two letters immediately to the left of (n + 1) cannot form a descent. 
So, 

Cn+1,A: = ^ ] ( . j Ci^Dn-i + C«,fc-1 + C n ^. 
i>0 \ l ' 

Multiplying both sides of the equality with x n /n\ and summing over n, 
we get the following differential equation 

(14) C' k {x) = (D(x) + l)C k (x) + C fc _i(z). 

As when solving Equation (|H]), it is convenient to introduce the 
function T(x) such that T'(x) = D(x) + 1. Moreover, Equation (|14]) is 
similar to Equation (pj) and we can solve it in the same way. Also we 
observe that from the definitions, Ci(t) = D(t), and thus 

C k (x) = e T{x) / / ■ ■ • / e-^C^dtdU ■ ■ ■ dt k _ 2 = 



Jo 



□ 
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7. Summarizing the results from sections 4,5 and 6 

We recall that the reverse R(tc) of a permutation ir = a\a 2 . . . a n is 
the permutation a„a„_i . . . a\ and the complement C(tt) is the permu- 
tation ■ ■ ■ b n where hi = n + 1 — Oj. Also, R o C is the composition 
of R and C. We call these bijections of S n to itself trivial. Let be 
an arbitrary trivial bijection. It is easy to see that, for example, there 
are as many permutations avoiding the pattern 132 as those avoiding 
the pattern 0(132). Moreover if, for instance, a permutation n begins 
with a decreasing pattern of length k, then depending on 0, 0(7r) either 
begins with an increasing pattern, or ends with either a decreasing or 
increasing pattern of length k. This allows us to apply Theorems 6 - 
11 to a number of other cases. We summarize all the obtained results 
concerning avoidance of a generalized 3-pattern with no dashes and 
beginning or ending with either increasing or decreasing subword, in 
the table below. 
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avoid 


begin 


end 


e.g.f. 


1 


123 
123 

621 
321 


12... k 
K ... AY 


12 ... k 
A ... 21 


f jI* , if A = 1 

2 cos(^+f) 2 2 tai H 2 a;+ 6 j,it/c-^ 
0, if k > 3 


2 


123 
123 

321 

321 


A: ... 21 
12... k 


A ... 21 
12 ... k 


f ^ , if A = 1 

2 cos(^x+f)' 

e^/^e-^-isinC^t+f)) dt „ 
(fc-l)!cos(^x+f) ' - 


3 


132 
213 

312 

231 


12... k 
A; ... 21 


12... k 
A ... 21 


(i-/; e -* 2 / 2 d*)- 1 , if fc = i 

e^ 2 / 2 (l - /;e-* 2 / 2 dt^ 1 - x - 1, if A = 2 

(i-/; e - 2 / 2 ^)-VoVo fc - 2 ---/o 2 (^ /2 - 

(ti + 1)(1 - /q 1 e-* 2 / 2 dt))dt x dt 2 ■ ■ -dt k _ 2 , if A > 3 


4 


132 
213 

312 
231 


A; ... 21 
12... k 


A ... 21 
12 ... A 


(i-/; e ^ 2 / 2 d*)- 1 , if *; = i 

- — - r i ti!0 - Ct k - l e~ t2 l 2 dt, if k > 2 


5 


213 
132 

231 
312 


12... k 
A; ... 21 


12 ... k 
A ... 21 


(i-/; e -* 2 / 2 d*)- 1 , if fc = i 

/o io ik-W-fle-^/'dm) ^ ' lf ^ 2 ' Where 

T(x)= x^ + JZ^S^dt 


6 


213 

132 
231 
312 


A ... 21 
12 ... A 


A ... 21 
12 ... A 


(1- j*e-*' 2 dt)-\ if fc = 1 

fc-2 

x fc-i : p X ft n fti C fe _ n (t)+<5 njfc _ 2 ^ + ^, + j + 
(fc-l)l 1 Z^JO JO JO l-/*e-™ 2 /2dm ttIttl1 ttI?1 ' 
n=0 

if A > 2, where C7 fc (x) = e T ^ f* J^ 2 ■ ■ ■ f* 1 e~ T «- 
^- — t — l^j dtdti ■ ■ ■ dt k _ 2 and T(x) as above 
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